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(54) IMAGE COMPOSITING DEVICE 

(57)Abstract: 

PURPOSE* To obtain a composited image full of expression by utilizing effectively a 
communication characteristic of two-way CATV so as to allow plural terminal equipments to 
make mutual information exchange. 

CONSTITUTION- Information management sections 16, 17 of a terminal aid device 102 of a 
center manage image information of a foreground and a background in the centralized image 
compositing system. An image compositing section 18 manages specific information of an object, 
position information and mutual interference information and composites the image 
information according to input information firom a terminal equipment 101 and sends the result 
as video information to each terminal. Furthermore, in the distributed image compositing 
system, when foreground information fi-om a terminal is received by the aid device, it is sent 
from the aid device to each terminal together with the managed background information and at 
each terminal an image is composited based thereon. When a request comes from other 
terminal, the information is sent to each terminal via the terminal aid device. Thus, the two- 
way CATV having a high communication capacity from the center to each home terminal and 
having a small communication capacity in the reverse direction is used effectively to composite 
images. 
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CLAIMS 
[Claim(s)] 

[Claim l] A foreground screen creation means to create at least one or more foreground images, 
and a background-image creation means to create at least one or more background images, The 
foreground screen creation information management means for managing the information for 
creating a foreground image, The background screen creation information management means 
for managing the information for creating a background image, A screen composition means to 
compound at least one or more foreground images and at least one or more background images, 
and to generate an image, An I/O means by which the terminal exchange equipment possessing 
the terminal exchange control means which controls each means of a transmission means to 
transmit information outputs and inputs information, The image synthesizer unit characterised 
by controlling and managing at least one or more terminal units possessing a transmission 
means to transmit information, and the terminal control means which controls each [ these ] 
means. 

[Claim 2] The image synthesizer unit according to claim 1 characterized by for terminal 
exchange equipment performing composition of a foreground image and a background image, 
and transmitting the result to at least one or more terminal units for image information. 
[Claim 3] A background-image creation means to create at least one or more background images, 
and the background 'image creation information management means for managing the 
information for creating a background image, An I/O means by which the terminal exchange 
equipment possessing a transmission means to transmit information, and the terminal 
exchange control means which manages each [ these ] means outputs and inputs information, A 
transmission means to transmit information, and a foreground screen creation means to create 
at least one or more foreground images, The foreground screen creation information 
management means for managing the information for creating a foreground image, The image 
synthesizer unit characterized by controlling and managing at least one or more terminal units 
possessing an image composition means to compound at least one or more foreground images 
and at least one or more background images, and the terminal control means which controls 
each [ these ] means. 

[Claim 4] The image synthesizer unit according to claim 3 characterized by transmitting the 
background-image information which consists of image information from said terminal 
exchange equipment to said at least one or more terminal units, and compounding a foreground 
image and a background image with said at least one or more terminal units while transmitting 
the information for creating a foreground image from terminal exchange equipment to at least 
one or more terminal units. 

[Claim 5] The image synthesizer unit according to claim 3 characteri;&ed by transmitting the 
information for creating a foreground image from said at least one or more terminal units to 
said other one or more terminal units one by one at least, transmitting the background-image 
information constituted from image information by said at least one or more terminal units 



from said terminal exchange equipment, and compounding a foreground image and background- 
image information with said at least one or more terminal units. 

[Claim 6] An image synthesizer unit given in either of claims 2, 4, or 5 characterized by using a 
portrait image as information for [ of a terminal unit ] carrying out foreground-image creation. 
[Claim 7] An image synthesizer unit given in either of claims 2, 4, or 5 characterized by using a 
portrait or a face image as information for [ of a terminal unit ] carrying out foreground image 
creation, 

[Claim 8] The image synthesizer unit according to claim 1 or 3 characterized by providing an 
object proper information management means to manage the proper information on the object 
which creates an image, the positional information management tool between objects which 
manages the positional information between objects, a mutual-intervention information 
management means between objects to manage the information on the mutual intervention 
between objects, and the image composition control means which controls each [ these ] means. 
[Claim 9] The image synthesizer unit according to claim 8 characterized by controlling the 
image composition approach based on the information which possesses an image characteristic 
quantity extract means to extract the characteristic quantity of an image, in a terminal control 
means, and said image feature-extraction means manages from the image information inputted 
from the I/O means of a terminal unit. 

[Claim 10] The image synthesizer unit according to claim 8 characterized by controlling the 
image composition approach based on the information which possesses an image characteristic 
quantity extract means to extract the characteristic quantity of an image, in a terminal 
exchange control means, and said image characteristic quantity extract means manages from 
the image information inputted from the I/O means of a terminal unit. 
[Claim 1 1] An image characteristic-quantity extract means is the image synthesizer unit 
according to claim 9 or 10 which possesses a means extract the characteristic quantity of at 
least one or more images among a hue characteristic- quantity extract means investigate the 
hue information on an image, a brightness characteristic-quantity extract means investigate the 
brightness information of an image, and a saturation characteristic-quantity extract means 
investigate the saturation information on an image, and is characterized by to consist of image 
characteristic-quantity extract control means which control a means extract the characteristic 
quantity of the image provided, and manage. 

[Claim 12] The image synthesizer unit according to claim 8 characterized by controlling the 
image composition approach based on the information which possesses a voice characteristic 
quantity extract means to extract audio characteristic quantity, in a terminal control means, 
and said voice characteristic quantity extract means manages from the speech information 
inputted from the I/O means of a terminal unit. 

[Claim 13] The image synthesizer unit according to claim 8 characterized by controlling the 
image composition approach based on the information which possesses a voice characteristic 
quantity extract means to extract audio characteristic quantity, in a terminal exchange control 
means, and said voice characteristic quantity extract means manages from the speech 
information inputted from the I/O means of a terminal unit. 

[Claim 14] A voice characteristic quantity extract means is an image synthesizer unit according 
to claim 12 or 13 characterized by consisting of means to extract the characteristic quantity of 
at least one or more voice among a sound-volume extract means to investigate audio magnitude, 
a voice pitch extraction means to investigate an audio pitch, and an utterance instruction 
extract means to investigate an utterance instruction of a user. 
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[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image synthesizer unit which exchanges 
information among two or more terminals, and performs image composition of rich power of 
expression. 
[0002] 

[Description of the Prior Art] By extracting a portrait image, for example, and conventionally, 
superimposing and displaying the image of the imagination space displayed as the other party 
beforehand remembered to be the image and the portrait image sent from the other party in 
common out of the image of the scenery of oneself side space a feeling of actual existence that 
there is a partner before himself is satisfied, and there are some which aimed at the image 
communication link with presence (the Japanese Patent PubUcation No. No. 24914 [ four to ] 
official report -) "Hypermedia personal computer communication system" (it Fukuda(s)) K., 
Tahara, T., and Miyoshi, T. ^"Hypermedia Personal Computer Communication System* Fujitsu 
Habitat", FUJITSUSci.Tech.J., 26, 3, pp.l97-206(October 1990)., Nakamura: "Distribution 
common [ by the virtual reality corresponding to a network ] activity exchange" Information 
Processing Society of Japan audio-visual compound information processing study group (1993). 
[0003] By the Prior art, the system for offering the pictorial communication service to which 
image composition was applied on the assumption that communication environment with 
almost equal engine performance and channel capacity between each terminal like the 
conference system which considered use in office has been considered. Therefore, it is not taken 
into consideration about the image communication system adapting the image composition on 
condition of the bottom of communication environment like CATV with which the engine 
performance between each terminal differs greatly, and the channel capacity between terminals 
differs greatly. 

[0004] With the conventional technique, since a communication band like Ethernet or N-ISDN 
was aimed at the narrow system, image composition of rich power of expression which utilized 
animation information was not realized. Moreover, the channel capacity from the end of a pin 
center,large side edge to the end of a home side edge was large, and the channel capacity of hard 
flow had conventionally many applications which transmit the existing software packages, such 
as a movie and a game, to the end of a home side edge firom the end of a pin center,large side 
edge according to a demand of a user in small bidirectional CATV (the communication mode of 
image composition which harnessed the communication link property of bidirectional CATV is 
not taken into consideration). In addition, not only the bidirectional CATV of a cable but the 
image from the end of a pin center,large side edge (broadcasting station) to the end of a home 
side edge and audio transmission of the communication configuration currently taken into 
consideration by this invention may be electric wayes (for example, a VHF band, a UHF band), 
and an exchange of the control data of the end of a pin center,large side edge and the end of a 
home side edge may be the telephone line and N-ISDN of an analog. 
[0005] Moreover, in the Prior art, the foreground-image coniponents (for example, person 
character) and background image ("a crest and the sun" which become the scenery expressed by 
image information similarly) which were expressed by the image information which creates a 
foreground beforehand in the end of a home side edge are given to CD-ROM etc. (the system 
designer opts for distinction of a foreground and a background beforehand). If a user generates 
the command demand which operates foreground information and background information firom 
a certain end of a home side edge, the foreground information and background information 
which are displayed in the end of other users' home side edge will be made to change via the end 
of a pin center,large side edge etc. according to a command demand using the communication 
line of a low speed like the telephone line of an analog (exchange of only a command). Therefore, 
the image communication system with presence with the motion using the communication link 
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property of CATV which used effectively animation information which has been realized by this 
invention is not realizable. 

[0006] Furthermore, since the user needed to operate the synthetic approach of an image clearly 
[ a user ] using the keyboard or an input device called a mouse, it was not enough as performing 
image composition according to the use situation of a user's terminal. [ of a Prior art . 
[0007] 

[Problem(s) to be Solved by the Invention] By the conventional technique, in order, to realize 
pictorial communication service which utilized image composition, the image components (for 
example, person character) and background image (similarly expressed by image information) 
which were expressed by the image information which creates a foreground beforehand in the 
end of a home side edge are given. If the command demand whose user operates foreground 
information and background information from a certain end of a home side edge occurs, the 
foreground information and background information which are displayed in the end of other 
users' home side edge will be made to change via the end of a pin center,large side edge etc. 
according to a command demand using the communication line of a low speed like the telephone 
line of an analog. Therefore, the channel capacity from the end of a pin center,large side edge to 
the end of a home side edge is large, and the channel capacity of hard flow has the technical 
problem that the pictorial communication service which utilized the image composition of the 
rich power of expression which used the small communication link property of bidirectional 
CATV effectively is not realizable. 

[0008] The purpose of this invention aims at exchanging information among two or more 
terminals, and realizing the image synthesizer unit in which the image composition of rich 
power of expression is possible. 
[0009] 

[Means for Solving the Problem] A foreground screen creation means by which this invention 
creates at least one or more foreground images, A background-image creation means to create at 
least one or more background images, and the foreground screen creation information 
management means for managing the information for creating a foreground image. The 
background screen creation information management means for managing the information for 
creating a background image, A screen composition means to compound at least one or more 
foreground images and at least one or more background images, and to generate an image, An 
I/O means by which the terminal exchange equipment possessing the terminal exchange control 
means which controls each means of a transmission means to transmit information outputs and 
inputs information, It is the configuration of performing at least one or more, control, and 
management for the terminal unit possessing a transmission means to transmit information, 
and the terminal control means which controls each [ these ] means. 

[00 10] Or a background-image creation means to create at least one or more background images. 
The background-image creation information management means for managing the information 
for creating a background image. An I/O means by which the terminal exchange equipment 
possessing a transmission means to transmit information, and the terminal exchange control 
means which manages each [ these ] means outputs and inputs information, A transmission 
means to transmit information, and a foreground screen creation means to create at least one or 
more foreground images, The foreground screen creation information management means for 
managing the information for creating a foreground image, It is the configuration of controlling 
and managing at least one or more terminal units possessing an image composition means to 
compound at least one or more foreground images and at least one or more background images, 
and the terminal control means which controls each [ these ] means. 
[0011] 

[Function] In this invention, it is possible to exchange information among two or more terminals, 

and to perform image composition of rich power of expression, 

[0012] 
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[Example] Hereafter, the example of this invention is explained with reference to a drawing. 
Drawing 1 is the outline block diagram of the image synthesizer unit in one example of this 
invention. When CATV is targetted, the configuration of drawing 1 concentrates the information 
about image composition in the end of a pin center,large side edge (terminal exchange 
equipment 102), performs management and image composition, and is equivalent to the system 
configuration Fig. of the centralized-control mold for transmitting with an image in the 
information by which image composition was carried out to the end of a home side edge 
(terminal unit 101). 

[0013] The I/O sections 11 which constitute the image composition terminal unit 101 are I/O 
devices, such as a camera, a scanner, a keyboard, a mouse, a digitizer, a touch panel, a light pen, 

a tablet, a microphone, a display, a loudspeaker, and a printer. 

[0014] Transmission parts 12 are transmission equipment, such as LAN, CATV, a modem, and 
a digital private branch exchange. The terminal control section 13 consists of means to control 
the I/O section 11 and a transmission part 12, and to manage. 

[0015] The foreground screen creation section 14 which creates a foreground image, and the 
background screen creation section 15 which creates a background image, With the foreground 
screen creation Research and Data Processing Department 16 for managing the information for 
creating a foreground image With the background screen creation Research and Data 
Processing Department 17 for managing the information for creating a background image The 
terminal exchange equipment 102 possessing the screen composition section 18 which 
compounds a foreground image and a background image and generates an image, and the 
terminal exchange control section 20 which controls each part of the transmission part 19 which 
performs informational transmission controls at least one or more previous terminal units 101, 
and it manages. 

[0016] In addition, the previous foreground screen creation Research and Data Processing 
Department 16 and the background screen creation Research and Data Processing Department 
17 are equipments, such as a magnetic disk, VTR, and an optical disk. Moreover, the 
information made to manage in the foreground screen creation Research and Data Processing 
Department 16 and the background screen creation Research and Data Processing Departnient 
17 makes the information on a foreground image (for example, a person character, "human 
being and a bird"), and the information on a background image (for example, the image of "the 
crest and the sun" which become scenery, animation information, CG) specifically manage, 
respectively. In addition, a system designer combines distinction of foreground information and 
background information with an application, and opts for it beforehand. In addition, not only 
the bidirectional CATV of a cable but the image fi*om the end of a pin center,large side edge 
(broadcasting station) to the end of a home side edge and audio transmission of the 
communication configuration currently taken into consideration by this invention may be 
electric waves (for example, a VHP band, a UHF band), and an exchange of the control data of 
the end of a pin center,large side edge and the end of a home side edge may be the telephone 
line and N-ISDN of an analog. 

[0017] Drawing 2 is the outline block diagram of the image synthesizer unit of the distributed 
management mold in one example of this invention. The configuration of drawing 2 is 
equivalent to the system configuration Fig. of the distributed management mold aiming at 
mitigating the load of the system in the end of a pin center,large side edge by performing image 
composition in the end of each home side edge (terminal unit 201), without processing image 
composition in the end of a pin center,large side edge (terminal exchange equipment 202), when 
CATV is targetted. Moreover, since delivery is performed with an image and each terminal unit 
201 performs image composition according to an individual for a background image compared 
with the configuration of drawing 1 , the image composition with the motion of rich power of 
expression according to each user*s use situation is attained. On the contrary, since processing 
of image composition is needed with a terminal unit 201, compared with the terminal unit of 



drawing 1 , a high throughput is needed by the terminal unit 201 side. 

[0018] The I/O sections 21 which constitute the image composition terminal unit 201 are I/O 

devices, such as a camera, a scanner, a keyboard, a mouse, a digitizer, a touch panel, a light pen, 

a tablet, a microphone, a display, a loudspeaker, and a printer. Moreover, transmission parts 22 

are transmission equipment, such as LAN, CATV, a modem, and a digital private branch 

exchange. 

[0019] It consists of the screen composition section 25 which compounds the foreground screen 
creation section 23 which creates a foreground image, the foreground screen creation Research 
and Data Processing Department 24 for managing foreground information, a foreground image, 
and the background image sent as image information from terminal exchange equipment 202, 
and a terminal control section 26 which controls these each part and is managed. Moreover, the 
terminal exchange equipment 202 possessing the background screen creation section 27 which 
creates a background image, the background screen creation Research and Data Processing 
Department 28 for managing the information for creating a background image, and the 
terminal exchange control section 30 which controls each part of the transmission part 29 which 
performs informational transmission controls at least one or more previous terminal units 201, 
and terminal exchange equipment 202 is managed. 

[0020] In addition, the previous foreground screen creation Research and Data Processing 
Department 24 and the background screen creation Research and Data Processing Department 
28 are equipments, such as a magnetic disk, VTR, and an optical disk. Not only the bidirectional 
CATV of a cable but the image from the end of a pin center,large side edge (broadcasting 
station) to the end of a home side edge and audio transmission of the communication 
configuration currently taken into consideration by this invention may be electric waves (for 
example, a VHP band, a UHF band) like drawing 1 , and an exchange of the control data of the 
end of a pin center,large side edge and the end of a home side edge may be the telephone line 
and N-ISDN of an analog. 

[0021] Drawing 3 is drawing explaining how to perform by distributing with the approach of 
performing image composition intensively. In the example of drawing, the "sun" and the image 
components of a "crest" are background images, and "people" and the image components of a 
"bird" are foreground images, (a) is a method which concentrates and performs image 
composition, and each image component is compounded with terminal exchange equipment. The 
compounded image information is transmitted to a terminal unit as image information, (b) is a 
method which distributes and performs image composition, and background-image components 
are transmitted to a terminal unit from terminal exchange equipment as image information. 
The image of the transmitted background image is compounded with the foreground-image 
components which were compounded with the foregroundumage components incorporated from 
the terminal unit with each terminal unit, or were transmitted from other terminal units and 
terminal exchange equipment. 

[0022] Drawing 4 is drawing explaining the transmission approach of foreground components 
and a background article. It is one of whether as shown in drawing, in the image composite 
system of the concentration mold of (a), foreground components are transmitted to terminal 
exchange equipment (pin center,large terminal) from a terminal unit (terminal), or it is 
managed with terminal exchange equipment. As stated previously, foreground components and 
a background article are created as image information with terminal exchange equipment, and 
are transmitted to each terminal unit. In the distributed process input output equipment image 
composite system of (b), the foreground components and image composition which have 
transmitted the background image to each terminal unit from the foreground components which 
the information which transmitted for image information, and their terminal unit hold, the 
foreground components transmitted from other terminal units, or terminal exchange equipment 
are performed from terminal exchange equipment to a terminal unit. In distributed process 
input output equipment image composition of (c), background-image information is distributed 
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to each terminal unit as image information from terminal exchange equipment. Moreover, 
information is transmitted in the shape of a loop formation in between terminal units, without 
the information on foreground-image components going via terminal exchange equipment. The 
big difference between distributed process input output equipment and a concentration mold is 
a difference in the load for the image composition concerning terminal exchange equipment, as 
stated previously. 

[0023] Moreover, since foreground components are not transmitted to terminal exchange 
equipment compared with (b) in (c), as for the difference between (b) and (c), the load to 
terminal exchange equipment becomes small. On the other hand, in (c), in order that a terminal 
unit may add during processing of image composition or may newly delete, it takes time and 
effort. Then, time and effort can be reduced by terminal exchange equipment's comparing the 
condition of foreground components that maintain coordination, and each terminal unit 
manages the foreground components which between each terminal has when every fixed time 
amount and a terminal unit are added suitably and a terminal unit is deleted, in order to 
participate the middle and to delete, and adjusting. However, it does not adjust by comparing 
the condition of the foreground components which each terminal unit manages, but can realize 
also by the approach of terminal exchange equipment having between terminal units, and 
performing around (what is necessary is just to decide the terminal unit which plays the role of 
terminal exchange equipment). Especially (c) is effective when uniting and using networks of a 
different kind, such as CATV, and existing LAN and existing ISDN of a uni directional. 
[0024] Drawing 5 is drawing explaining the configuration of the screen composition section. The 
image composition section explained by drawing 1 and drawing 2 consists of each part of the 
object proper Research and Data Processing Department 51 which manages the proper 
information on the object which creates an image, the positional information Management 
Department 52 between objects which manages the positional information between objects, the 
mutual-intervention Research and Data Processing Department 53 between objects which 
manages the information on the mutual intervention between objects, and the image 
composition control section 54 which controls these each part. Concrete management 
information is explained below. 

[0025] Drawing 6 - drawing 10 are drawings explaining the information which the object proper 
Research and Data Processing Department which manages the proper information on the object 
which creates an image manages. In the example of drawing 6 , as information managed, the 
information on foreground components is managed (it is the same as the information which the 
foreground screen creation Research and Data Processing Department memorizes and manages), 
and each information on how (production Ruhr) to serve a character name (name of foreground 
components), a character ID, the magnitude of the character, a main coordinate (barycentric 
coordinates of the character), and the character is managed. Drawing 7 expresses visually the 
information managed by drawing 6 . In the example of drawing 8 , the information on a 
background image is managed (it is the same as the information which the background screen 
creation Research and Data Processing Department memorizes and manages), and each 
information on a production code which shows the contents of the stage effects as a background- 
image name, a background image ID, and a background image is managed. In the example of 
drawing 8 , the image information expressing the stage effects at the time of the collision and 
encounter between the characters is managed as information on foreground components 
contrary to the example of drawing 6 by the example shown in drawing 9 , although managed as 
information on a background image. Therefore, in the example, shown in drawing 10 , a robot 
and a stone are managed as information on foreground components. In addition, as shown in 
drawing, whether the effectiveness at the time of a collision is foreground information or it is 
background information should just manage application suitably according to a system 
designer's purpose at the time of a design. In addition, a sound effect may be similarly 
registered as information for production for the purpose to which a user raises the effectiveness 
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of production with the information which the user registered as foreground'image components. 
[0026] Drawing 11 - drawing 14 are drawings explaining the positional information 
Management Department between objects which manages the positional information between 
objects. The concrete management information which the positional information Management 
Department between objects manages is described. In the example of drawing, the coordinate 
location where the character ID and the current character of the foreground components by 
which current use is carried out exist is managed. Although not shown in drawing, management 
of the coordinate location of a background image is also realizable in the same way. In addition, 
what is necessary is to build a foreground image and a background image as three-dimension 
information, and just to take depth information into consideration in that case (what is 
necessary is just to take depth into consideration like three-dimension CG etc. in consideration 
of the lap condition between characters for two-dimensional information). The situation of 
having not collided even if the two characters have lapped can be made. . 
[0027] Drawing 12 shows the concrete example which performs the collision judgement of a 
background image and a foreground image. The illustrated example is an example which judges 
whether a bird collides with a tree. A bird is managed as foreground components, a tree is 
managed as a background article, and the information on components propers, such as 
magnitude and a main coordinate of components, is managed in the object proper Research and 
Data Processing Department which stated previously. Moreover, the condition of each present 
image component is managed at the positional information Management Department between 
objects which explained by drawing 11 . In the example of drawing, measurement of the 
approach distance between objects is performed based on the main coordinate of each 
component. If it becomes uniformly smaller, it will judge with a collision, and based on the Ruhr 
of the stage effects on the screen at the time of a collision of the mutual-intervention Research 
and Data Processing Department between objects which manages the information on the 
mutual intervention between the objects with approach distance stated by drawing 15 , the 
stage effects on a series of screens are realized. 

[0028] In addition, as shown in drawing, foreground components and a background article may 
be animations. Moreover, the image (as shown in drawing 13 , a user may be freely possible for 
control of a camera) incorporated from the camera when the whole background image was niade 
into image information and the image which carried out clipping of a part of image information 
(it starts) (For example, image shown in drawing 14 ) With the image currently recorded on 
VTR etc. The specific field of each image scene (for example, if the image about a "crest", the 
"sun", and a "tree" is recorded) By making it correspond to each image scene, recording and 
making the attribute (attribute) that the background image which should be carried out a 
colhsion judgement exists in the field to which the "tree" is photoed especially manage, even if a 
background is an image, collision judgement processing with foreground components is 
realizable. 

[0029] Drawing 15 is drawing explaining the mutual-intervention Research and Data 
Processing Department between objects which manages the information on the mutual 
intervention between objects. In the example of drawing, it is managed about the stage effects 
on the screen of the (a) foreground image or a background image. Based on the information on 
(a), the production Ruhr of a single string of the foreground image on a screen or a background 
image which has flow in time is defined in consideration of a time-axis, for example, the case of 
pat#l " the time of an encounter (when the approach distance between objects becomes below 
fixed) " "explosion" - at the time of a collision, it directs further "it falls" (when it becomes 
smaller than the threshold value of the approach distance beforehand decided with application). 
[0030] Drawing 16 , drawing 17 , and drawing 18 are drawings explaining the exchange of 
concrete information including the time progress between terminals. In addition, the method of 
drawing 16 to drawing 18 is equivalent to the method of (c) from isd shown in previous drawing 
4. 



[0031] In the method of the centralized-control mold which focuses and performs ima^e 
composition shown in drawing 16 , for example, the foreground images (for example, their 
person image, a face image, a portrait, three -dimension CG, an image, etc.) which the terminal 
unit A (terminal A) transmitted are compounded with reception and background images (a 
static image, three-dimension CG, image, etc.) with terminal exchange equipment, and the 
synthetic result is transmitted to each terminal as image information. A user's use volition 
increases by using as information on image composition of one's face image especially. Moreover, 
it is transmitted from a terminal B to terminal exchange equipment, and the command -(for 
example, the instruction for fixing beforehand between the terminal unit "migration (right)", 
and terminal exchange equipment,, and operating foreground components) which operates 
foreground components operates foreground components, is compounded with terminal 
exchange equipment with the operated foreground components image and the background 
image according to the command which operates foreground components, and is transmitted to 
each terminal unit. In addition, by the above-mentioned approach, processing concentrates with 
each terminal exchange equipment, and the collision judgement of a background image, a 
foreground image, and foreground images etc. is performed. 

[0032] By the method which drawing 17 distributes and performs image composition, a 
foreground image is transmitted to terminal exchange equipment from Terminal A, and it is 
transmitted to each terminal, for example. Moreover, foreground components are transmitted to 
each terminal unit from terminal exchange equipment. In each terminal unit, image 
composition is performed with the image information on the background transmitted from 
terminal exchange equipment. Furthermore, if the actuation demand which operates foreground 
components from Terminal B occurs, it will be transmitted to each terminal unit via terminal 
exchange equipment. In addition, by the above-mentioned approach, processing distributes with 
each terminal unit and the collision judgement of a background image, a foreground image, and 
foreground images etc. is performed. 

[0033] The root beforehand fixed by the system by the method which drawing 18 distributes and 
performs image composition, for example when foreground components were transmitted from 
Terminal B (to which terminal, from delivery and which terminal, each terminal has memorized 
whether information comes and has managed information.) Foreground components are 
transmitted in order, without minding terminal exchange equipment by communication 
configuration like a token ring like FDDI. Moreover, an actuation command is transmitted in 
order also about the actuation to foreground components, without minding terminal exchange 
equipment. In addition, by the above-mentioned approach, processing distributes with each 
terminal unit and the collision judgement of a background image, a foreground image, and 
foreground images etc. is performed. 

[0034] Drawing 19 and drawing 20 are drawings explaining the informational example in which 
it is exchanged with terminal exchange equipment or a terminal unit. As shown in drawing 19 , 
as information exchanged between terminals, it consists of arguments of a character ID 
(foreground components or background article), Command ID (actuation ID of components), and 
a command transmission place and transmitting origin, for example. As a concrete command, as 
shown in drawing 20 , information, such as a command name, Command ID, a command 
argument, and the contents of activation of a command, is managed. 

[0035] Drawing 2 1 is drawing explaining the image characteristic quantity extract section. The 
extract of the characteristic quantity of an image is performed with the configuration of drawing 
1 by concentrating by the terminal exchange control section 20 of terminal exchange equipment 
102. Moreover, with the configuration of drawing 2 , it distributes by the terminal control 
section 26 of a terminal unit 201, and the extract of the characteristic quantity of an image is 
performed. The image characteristic quantity extract section which extracts characteristic 
quantity of an image consists of image characteristic quantity extract control sections 1904 
which control the hue characteristic quantity extract section 1901 which investigates the hue 



information on an image, the brightness characteristic quantity extract section 1902 which 
investigates the brightness information of an image, the saturation characteristic quantity 
extract section 1903 which investigates the saturation information on an image, and each part 
which extracts the characteristic quantity of an image, and are managed. A user becomes 
possible [ performing image composition according to the use situation of a user's terminal ] 
without a user's operating it clearly using input devices by quantifying the relation between 
change, of the characteristic quantity of an image, and the stage effects stated by drawing 15 , 
such as a keyboard and a mouse. For example, production of the foreground components set by 
the motion of a user or a background article can be performed in the online karaoke using image 
composition, education, etc. (for example, a screen carries out [ that a screen is in disorder, ] a 
flash plate). 

[0036] Drawing 22 is drawing explaining the voice characteristic quantity extract section. The 
extract of audio characteristic quantity is performed with the configuration of drawing 1 by 
concentrating by the terminal exchange control section 20 of terminal exchange equipment 102. 
Moreover, with the configuration of drawing 2 , it distributes by the terminal control section 26 
of a terminal unit 201, and the extract of audio characteristic quantity is performed. The voice 
characteristic quantity extract section which extracts audio characteristic quantity consists of a 
loudness level detecting element 2001 which investigates a loudness level, the voice pitch 
extraction section 2002 which investigates the pitch of a sound and the utterance instruction 
extract section 2003 which investigates an utterance instruction of a user, and a voice 
characteristic quantity extract control section 2004 which controls these each part and is 
managed. After letting a low pass filter pass in pitch detection of a sound to the sound signal 
gathered, for example with the microphone and removing a harmonic-overtone part, A/D 
conversion is carried out with the sampling firequency of 20kHz, and a primitive period is 
calculated as 12-bit digital data. A primitive period measures the time amount between the 
peaks of the amplitude more than the threshold set up beforehand, and should just find it. As 
drawing 21 also described, a user becomes possible [ performing image composition according to 
the use situation of a user's terminal ] without a user's operating it clearly using input devices 
by quantifying the relation between change of audio characteristic quantity, and the stage 
effects stated by drawing 15 , such as a keyboard and a mouse. Moreover, using the rhythm of a 
sound and the characteristic quantity of voice called a tone in addition to the audio 
characteristic quantity shown previously is also considered. Production of the foreground 
components set by the motion of a user or a background article can be performed in the online 
karaoke using image composition, education, etc. like the point. 
[0037] 

[Effect of the Invention] As mentioned above, according to this invention, the channel capacity 
firom the end of a pin center,large side edge to the end of a home side edge is large, and the 
channel capacity of hard flow can realize pictorial communication service which utilized the 
image composition of the rich power of expression which used the small communication link 
property of bidirectional CATV effectively. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] The outline block diagram of the centralized'control mold of the image synthesizer 
unit of this invention 

[Drawing 2] The outline block diagram of the distributed management mold of the image 
synthesizer unit of this invention 



[Drawing 3] (a) and (b) are drawing showing how to perform by distributing with the approach 
of performing image composition intensively. 

[Drawing 4] (a) - (c) is drawing showing the transmission approach of foreground components 

and a background article. 

[Drawing 5] Drawing showing the configuration of the image composition section 
[Drawing 6] Drawing showing the information which the object proper Research and Data 
Processing Department which manages the proper information on the object which creates an 
image manages 

[Drawing 7] Drawing showing the information which the object proper Research and Data 
Processing Department which manages the proper information on the object which creates an 
image manages 

[Drawing 8l Drawing showing the information which the object proper Research and Data 
Processing Department which manages the proper information on the object which creates an 
image manages 

[Drawing 9] Drawing showing the information which the object proper Research and Data 
Processing Department which manages the proper information on the object which creates an 
image manages . 

[Drawing 10] Drawing showing the information which the object proper Research and Data 
Proceissing Department which manages the proper information on the object which creates an 
image manages 

[Drawing 11] Drawing showing the positional information Management Department between 
objects which manages the positional information between objects 

[Drawing 12] Drawing showing the positional information Management Department between 
objects which manages the positional information between objects 

[Drawing 13] Drawing showing the positional information Management Department between 
objects which manages the positional information between objects 

[Drawing 14] Drawing showing the positional information Management Department between 
objects which manages the positional information between objects 

[Drawing 15] (a) and (b) are drawing showing the mutual-intervention Research and Data 
Processing Department between objects which manages the information on the mutual 
intervention between objects. 

[Drawing 16] Drawing showing the exchange of concrete information including the time 
progress between centralized-control mold terminals 

[Drawing 17] Drawing showing the exchange of concrete information including the time 

progress between distributed management mold terminals 

[Drawing 18] Drawing showing the exchange of concrete information including the time 
progress between distributed management mold terminals 

[Drawing 19] Drawing showing the informational example in which it is exchanged with 
terminal exchange equipment or a terminal unit 

[Drawing 20] Drawing showing the informational example in which it is exchanged with 
terminal exchange equipment or a terminal unit 

[Drawing 21] Drawing showing the image characteristic quantity extract section 
[Drawing 22] Drawing showing the voice characteristic quantity extract section 
[Description of Notations] 
Ill/O Section 

12 Transmission Part 

13 Terminal Control Section 

14 Foreground Screen Creation Section 

15 Background-Image Creation Section 

16 Foreground Screen Creation Research and Data Processing Department 

17 Background Screen Creation Research and Data Processing Department 



18 Screen Composition Section 

19 Transmission Part 

20 Terminal Exchange Control Section 

101 Terminal Unit 

102 Terminal Exchange Equipment 
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